Web Survey Bibliography
Title Pushing to web in the ISSP
Year 2017
Access date 08.09.2017
Abstract The use of mixed-mode surveys has become common in recent years, especially in countries with high internet penetration. The purpose of these mixed designs has been threefold: to improve population coverage, improve response rate and reduce survey costs. Self-administered questionnaires, both postal and web questionnaires are accepted as valid modes of data collection by the International Social Survey Programme (ISSP) making it an ideal vehicle for methodological experiments. This paper describes results from four different modules of the ISSP in Iceland where a random sample of the general population was either offered a choice of answering the questionnaire on paper or online, pushed to answer on the web or randomly assigned to the different modes in order to disentangle selection and mode effects.
The ISSP module on Environment in 2011 was implemented in Iceland as a mixed-mode survey: a probability sample of the general population under age of 50 was first contacted by telephone and asked to complete a questionnaire on the web, while those over age of 50 were allowed to choose web or mail (a concurrent mixed-mode design). In the ISSP module on Citizenship in 2014 five countries participated in a mode experiment where a probability sample of the general population was randomly assigned to different modes, web or paper. These countries were Denmark, Finland, Iceland and Norway, all with internet penetration over 90% and Spain with a somewhat lower internet penetration rate, under 80%. In four out of five countries, response rate turned out to be higher in the web mode than in the paper mode. In the ISSP module on Work Orientations 2015 a probability sample of the general population was, in a letter, invited to answer the questionnaire online but asked to send an e-mail or call if they preferred to answer on paper. Finally, in the ISSP module on Role of Government in 2016 a probability sample of the general population was invited to answer the questionnaire online, but telephone calls and text messages were used to boost the response rate.
Results show that response rate in internet surveys in countries with high internet penetration is in many cases higher than with other modes – and that for most of the survey variables in many respects a web survey alone may be the optimal method of collecting data, when considering the quality of answers, costs, bias and mean squared error.
The ISSP module on Environment in 2011 was implemented in Iceland as a mixed-mode survey: a probability sample of the general population under age of 50 was first contacted by telephone and asked to complete a questionnaire on the web, while those over age of 50 were allowed to choose web or mail (a concurrent mixed-mode design). In the ISSP module on Citizenship in 2014 five countries participated in a mode experiment where a probability sample of the general population was randomly assigned to different modes, web or paper. These countries were Denmark, Finland, Iceland and Norway, all with internet penetration over 90% and Spain with a somewhat lower internet penetration rate, under 80%. In four out of five countries, response rate turned out to be higher in the web mode than in the paper mode. In the ISSP module on Work Orientations 2015 a probability sample of the general population was, in a letter, invited to answer the questionnaire online but asked to send an e-mail or call if they preferred to answer on paper. Finally, in the ISSP module on Role of Government in 2016 a probability sample of the general population was invited to answer the questionnaire online, but telephone calls and text messages were used to boost the response rate.
Results show that response rate in internet surveys in countries with high internet penetration is in many cases higher than with other modes – and that for most of the survey variables in many respects a web survey alone may be the optimal method of collecting data, when considering the quality of answers, costs, bias and mean squared error.
Access/Direct link Conference Homepage (abstract) / (presentation)
Year of publication2017
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - European survey research associaton conference 2017, ESRA, Lisbon (26)
- Effects of sampling procedure on data quality in a web survey; 2017; Rimac, I.; Ogresta, J.
- Paradata as an aide to questionnaire design: Improving quality and reducing burden; 2017; Timm, E.; Stewart, J.; Sidney, I.
- Fieldwork monitoring and managing with time-related paradata; 2017; Vandenplas, C.
- Interviewer effects on onliner and offliner participation in the German Internet Panel; 2017; Herzing, J. M. E.; Blom, A. G.; Meuleman, B.
- Interviewer Gender and Survey Responses: The Effects of Humanizing Cues Variations; 2017; Jablonski, W.; Krzewinska, A.; Grzeszkiewicz-Radulska, K.
- Millennials and emojis in Spain and Mexico.; 2017; Bosch Jover, O.; Revilla, M.
- Where, When, How and with What Do Panel Interviews Take Place and Is the Quality of Answers Affected...; 2017; Niebruegge, S.
- Comparing the same Questionnaire between five Online Panels: A Study of the Effect of Recruitment Strategy...; 2017; Schnell, R.; Panreck, L.
- Nonresponses as context-sensitive response behaviour of participants in online-surveys and their relevance...; 2017; Wetzlehuetter, D.
- Do distractions during web survey completion affect data quality? Findings from a laboratory experiment...; 2017; Wenz, A.
- Predicting Breakoffs in Web Surveys; 2017; Mittereder, F.; West, B. T.
- Measuring Subjective Health and Life Satisfaction with U.S. Hispanics; 2017; Lee, S.; Davis, R.
- Humanizing Cues in Internet Surveys: Investigating Respondent Cognitive Processes; 2017; Jablonski, W.; Grzeszkiewicz-Radulska, K.; Krzewinska, A.
- A Comparison of Emerging Pretesting Methods for Evaluating “Modern” Surveys; 2017; Geisen, E., Murphy, J.
- The Effect of Respondent Commitment on Response Quality in Two Online Surveys; 2017; Cibelli Hibben, K.
- Pushing to web in the ISSP; 2017; Jonsdottir, G. A.; Dofradottir, A. G.; Einarsson, H. B.
- The 2016 Canadian Census: An Innovative Wave Collection Methodology to Maximize Self-Response and Internet...; 2017; Mathieu, P.
- Push2web or less is more? Experimental evidence from a mixed-mode population survey at the community...; 2017; Neumann, R.; Haeder, M.; Brust, O.; Dittrich, E.; von Hermanni, H.
- In search of best practices; 2017; Kappelhof, J. W. S.; Steijn, S.
- Redirected Inbound Call Sampling (RICS); A New Methodology ; 2017; Krotki, K.; Bobashev, G.; Levine, B.; Richards, S.
- An Empirical Process for Using Non-probability Survey for Inference; 2017; Tortora, R.; Iachan, R.
- The perils of non-probability sampling; 2017; Bethlehem, J.
- A Comparison of Two Nonprobability Samples with Probability Samples; 2017; Zack, E. S.; Kennedy, J. M.
- A test of sample matching using a pseudo-web sample; 2017; Chatrchi, G., Gambino, J.
- A Partially Successful Attempt to Integrate a Web-Recruited Cohort into an Address-Based Sample; 2017; Kott, P. S., Farrelly, M., Kamyab, K.
- Nonprobability sampling as model construction; 2017; Mercer, A. W.